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1.  Introduction 

X>Much  research  lias  centered  on  Mir  problem  of  finding  shortest  paths  in  graphs.  It  is  well 
known  Mu  t  there  i£>  a  direct  correspondence  between  the  single-source  shortesi-paths  'problem 
and  the  Id  lowing  simple  linear  programming  problem!  j 

Let  S  be  a  sdt  of  linear  inequalities  of  the  form  xf  —  if  £  at},  where  the  /<  are  unknowns 
and  tne  a^/are  given  real  constants.  Determine  a  set  of  values  for  the  x, -  such  that  the 
inequalities  in  S  are  satisfied,  or  determine  that  no  such  values  exist. 

This  paper  considers  the  mixed-integer  linear  programming  variant  of  this  problem  in  which  some 
(hut  not  n  'cessarily  all)  of  the  /,  are  required  to  be  integers.  The  problem  arises  iri  the  context 
of  synchronous  circuit  opt  imi/.al  ion  ■  ]9^  hut  it  has  applications  to  I’FliT  scheduling  and  VLSI 
layout  con  paction  as  well,  f  ’ i  *  ■  r-  v'r  '"s/  c»»  *  '  •  ’*  "•  <•>  p*  '  ’  ■  < 

Hefore  formally  defining  the  mixed- integer  programming  problem,  we  restate  the  linear  pro¬ 
gramming  problem  above  in  another  form. 

Prob  em  L.  Let  C  =  (V,  F.n\  be  an  t  dge -weighted,  directed  graph,  where  V  —  {1,2,..., 
|F|}  n  the  vertex  set,  the  set  F  of  edges  is  a  subset  of  V  X  V,  and  for  each  edge  ( i,j )  £  F  the 
edge  weight  aXJ  is  a  real  number.  Find  a  vector  x  —  [x\,  x^, . . .,  x^y  )  satisfying  the  constraint 
that 

r3  -  x,  <  atJ 

for  al  ( i,j )  £  ft,  or  determine  that  no  feasible  vector  exists. 

The  grapl  V,  is  called  a  constraint  graph  for  Iho  linear  programming  problem.  There  are 
three  advantages  in  adopting  a  graph  representation  of  the  problem.  First,  an  adjacency- list 
representation  [I,  p.  200]  of  the  constraint  graph  (!  is  more'  economical  than,  for  example,  a 
linear  pro;  ramming  tableau  or,  when  the  graph  lias  relatively  few  edges,  a  matrix  of  the  a,y. 
Second,  Problem  I,  frequently  arises  in  situations  that  are  naturally  described  by  a  graph.  Finally, 
the  graph- theoretic  formulation  helps  in  understanding  the  algorithms  that  solve  this  kind  of 
problem. 

A  method  for  solving  Problem  L  was  discovered  in  tbe  late  I950’s  by  Ford  and  Bellman  |8,  p. 
74].  Yen  [Ft]  gave  some  improvements  to  the  Ik'llman-Ford  algorithm  as  well  as  a  cogent  analysis 
showing  1,1  at  its  running  time  is  0(]V,'|'t).  'Phis  bound  is  easily  improved  to  0(|P||/v|)  by  using 
an  adjacency-list  representation  for  the  constraint  graph. 

The  Be  Iman-Ford  algorithm  can  also  be  used  to  solve  the  integer  linear  programming  variant 
of  Problcn  I.,  in  which  all  the  x,  are  required  to  be  integers.  If  the  edge  weights  ntJ  all  happen  to 
be  integers,  the  Bellman-Ford  algorithm  will  produce  integer  values  for  the  x,.  If  the  aXJ  arc  not 
integers,  h  iwever,  but  the  x,  are  required  to  be  integers,  each  edge  weight  aXJ  may  be  replaced 
by  [«,y]  vv  thou!,  a  Her  ling  the  sat  isfiablily  of  the  inequalities. 

The  foi  us  of  this  paper  is  the  mixed-integer  variant  of  Problem  L. 

Prob  em  MI.  Let.  (1  =  (F,l be.  a  tdgc-weighled,  directed  graph,  where  V  — 

{ 1 , 2 , . . .,  ] V  1}  is  the  vertex  set,  the  set  1/  is  a  subset  of  V,  the  set  li  of  edges  is  a  subset 
of  V  ,<  V ,  and  for  each  edge  U.j)  £  F  the  edge  weight  ax.j  is  a  real  number.  Find  a  vector 
x  —  (:•' i ,  X21  •  •  -i  -pv |)  satisfying  the  constraints  that 

x,  ~  f  i  $  at j 

for  all  ( i,j )  £  li  and  that  tZ  for  all  i  £  Vf,  or  determine  that  no  feasible  vector  exists. 


The  vector  x  =  (i\ ,  X2,  ■  ■  ■ ,  /|v|)  ls  called  a  solution  to  graph  (I,  ami  if  graph  G  has  a  solution, 
we  say  that  G  is  satisfiable.  When  it  is  clear  from  context,  we  use  the  same  terminology  for 
Problem  L. 

In  addition,  we  shall  refer  to  the  vertices  in  Vj  as  the  integer  vertices  of  G  and  Ihe  vertices  in 

VR  =  V  -  Vj  as  the  real  vertices  of  G.  We  also  partition  the  set  of  edges  into  two  sets  depending 

on  whether  the  vertex  at  the  head  of  the  edge  is  integer  or  real: 

Hi  =  {(i,j)  £  H  |  j  G  Vi)  , 

Hr  —  {(i,j)  €  H  |  j  G  17h}  ■ 

This  paper  presents  two  algorithms  to  solve  Problem  Ml.  The  first,  which  runs  in  f7(|l/||l’;||/,.,'|) 
time,  is  a  straightforward  extension  of  the  Hellman-Ford  algorithm.  The  second  is  more  sophis¬ 
ticated  and  has  a  running  time  of  0(|  V  ||/,’|  +  IV7  ||F/|  I V  I)-  We  conjecture  t  hat  Ihe  ()(\V  ||/t,’j) 
running  time  achieved  by  the  Mellman-Ford  algorithm  for  the  pure  linear  programming  and  pure 
integer  programming  versions  of  the  problem  is  not  achievable  in  general  for  sparse  instances  of 
Problem  Ml. 

The  remainder  of  this  paper  is  organized  as  follows.  Section  2  reviews  Ihe  Mellman-Ford 
algorithm.  Section  if  presents  a  simple  relaxation  algorithm  for  solving  Problem  Ml.  Section  \ 
discusses  three  techniques  Dijkstra’s  algorithm,  reweighting,  and  Fibonacci  heaps  which  arc 
used  in  Section  5  to  construct  an  asymptotically  efficient  algorithm  for  Problem  Ml.  We  discuss 
applications  and  present  some  concluding  remarks  in  Section  6. 

2.  Shortest,  paths  and  the  Bellman-Ford  algorithm 

This  section  reviews  how  the  Bellman-Ford  aigonthm  solves  Problem  L.  Although  the  results 
of  this  section  are  well  known  and  can  be  found  in  most  textbooks  on  combinatorial  optimization 
(see,  for  example,  [8,  p.  71]),  we  repeat  the  material  here  for  the  reader’s  convenience. 

There  is  a  natural  correspondence  between  Problem  L  and  the  graph-theoretic  single-source 
shor'est  paths  problem.  Let  G  =  V , n)  be  an  instance  of  Problem  L.  Suppose  that  for  each 
vertex  i  £  V',  there  is  a  path  to  i  from  vertex  1,  and  let  </,  be  the  weight  of  shortest  (least-weight) 
pat  h  from  vertex  1  to  vertex  t.  (At  the  end  of  the  section,  we  shall  discuss  the  case  in  which  some 
vert  ice-,  are  not  reachable  from  vertex  1.)  Then  for  any  edge  (i,j)  £  we  have  d,  —  d{  <  atJ 
since  Ihe  edge  ( i,j )  can  be  appended  to  a  shortest  path  from  vertex  1  to  vertex  t  to  produce  a 
path  from  vertex  I  to  vertex  j  of  weight  d,  +  atJ.  Thus  the  short est-path  weights  d  are  a  solution 
to  G 

Whenever  G  is  satisfiable,  there  are  infinite  number  of  solutions.  For  example,  if  x  is  a  solution 
i  u  t  /.  i  in  a  uniformly  adding  any  constant  k  to  each  x,  yields  anot  her  solution  y,  where  y,  =  x,  +  k 
•  i r  e.u  I  i  £  V  .  The  assignment  j,  <—  d,  gives  each  x,  its  largest  possible  value  subject  to  the 
con.  'ruin!  that  x(  =  0.  To  set'  this,  consider  any  path  ]>  of  weight  d,  from  vertex  I  to  vertex  i. 
If  Mu  i neipialities  associated  with  the  edges  of  p  are  summed,  the  unknowns  associated  with  the 
inti  r mediate  vertices  cancel  and  the  result  is  the  inequality  x,  —  X]  <  dx. 

Whenever  the  graph  G  contains  some  cycle  c  whose  weight  is  negative,  the  shortest  path 
weigh!  from  vertex  I  to  any  vertex  i  on  cycle  r  is  undefined  because  the  weight  of  any  path 
'o  vertex  i  can  be  diminished  by  appending  a  traversal  of  r.  In  this  case  the  graph  G  is  not 
sal isli.ible.  If  the  inequalities  associated  with  the  edges  of  r  are  summed,  all  the  unknowns  x, 
raneel,  arid  the  resulting  inequality  asserts  that  0  is  less  than  or  equal  to  the  weight  of  e,  which 
is  false. 
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The  Bellman-Ford  algor'll  Inn,  which  is  given  below,  solves  Problem  L  by  finding  the  weight 
of  tlii*  sliortesl.  |>ath  to  each  vertex  from  vortex  I.  Should  the  graph  contain  a  negative-weight 
cycle,  tin  algorithm  reports  that,  tin  graph  is  unsal  isfiablc  by  calling  the  procedure  Fail,  whose 
semantics  we  leave  unspecified. 

Algorithm  BF  (Bellman-  Ford  algorithm). 

BFI.  i,-0; 

BF2.  for  r  <—  2  to  |F  |  do  /,  «—  oo; 

BF.h  for  ind  *—  I  to  |F|  —  I  do 
III'  1.  foreach  (i,j)  F  F  do 

HI'T).  Xj  *-  min(zj,  z,  !-  n,;); 

BFG.  foreach  (;.  j)  £  F  do 
I  IF  7.  ifjj  >  x,  +  atJ  then  Fail", 

For  ear  h  vertex  j  £  l  ,  the  Bellman-Ford  algorithm  iteratively  updates  the  weight  x}  of  a 
tentative  saortest  path  from  vertex  I  to  vertex  j.  After  initialization,  the  algorithm  makes  |F|~  I 
passes  through  the  edges  in  F  and  relaxes  each  edge  (i,j)  by  computing  x}  *—  min(Zj,Ti  +  n,y). 

A  simple  analysis  <1  no  to  'ten  [Id]  indicates  why  the  Hell  man- Ford  algorithm  works.  'I'hc 
weight  fj  converges  to  t  he  weight  dj  of  a  shortest  path  from  vertex  I  to  vertex  j  if  t  he  edges  on 
the  path  are  relaxed  in  order  along  the  path.  The  sequence  of  edges  relaxed  by  the  Mellman-Ford 
algorithm  consists  of |F| —  I  copies  of  some  ordering  of  F,  and  therefore  contains  every  vertex- 
disjoint  path  as  a  subsequence.  If  there  are  no  negative-weight  cycles  in  <7,  then  every  shortest 
path  is  vertex  disjoint,  so  each  r,  converges  to  the  shortest-path  weigliL  d,.  On  the  other  hand, 
if  there  is  a  negative- weight  cycle  in  the  graph,  the  algorithm  detects  this  condition  by  iterating 
once  more  through  all  edges  to  see  whether  any  of  the  inequalities  remain  unsatisfied. 

The  llellman-Ford  algorithm  as  given  above  determines  the  weight  of  the  shortest  path  from 
vertex  1  to  each  vertex,  and  therefore  solves  Problem  I,  whenever  all  vertices  of  C  are  reachable 
from  vertex  1.  The  code  can  be  adapted  to  solve  Problem  L  on  arbitrary  graphs  by  simply 
changing  the  initialization  step  (lines  Bl'l  liF‘2).  In  particular,  if  each  z,  is  assigned  a  finite 
initial  value  v,,  the  relaxation  in  lines  BF.’l  BFf>  sets  each  z,  to  its  maximum  value  subject  to  the 
constraints  that  z;  -  /,  <  aXJ  for  each  edge  (i,j)  £  F  and  that  z,  <  ux  for  each  vertex  i  £  V. 
Notin'  that  whenever  t he  const  raint  graph  (!  is  satisliable.  it  is  satisfiablo  subject  to  the  additional 
constraints  z,  <  ?/,.  Should  the  inequalities  be  inconsistent  because  there  is  a  negative- weight 
cycles  in  hi  e  graph,  the  relaxation  will  not  converge  to  a  solution,  and  the  inconsistency  will  be 
detected  by  the  lest  in  lines  BFG  BF7. 

3.  Simple  relaxation  algorithms  for  Problem  MI 

As  was  mentioned  in  the  introduction.  Problem  Ml  can  be  solved  directly  by  the  Bellman- 
Ford  algor  Ihm  when  all  unknowns  are  mal  (Problem  I.)  and  when  all  unknowns  are  integer. 
The  combination  of  integer  and  real  unknowns,  however,  seems  to  make  the  problem  harder. 
In  this  section,  we  gain  some  intuition  about  the  structure  of  Problem  Ml  by  introducing  two 
algorithms  that  so!\>  it  in  ()[  1 1  'j.j  Vj  ||  F j)  time  much  the  same  way  as  the  Bellman-Ford  algorithm 
solves  Problem  L  The  asymptotically  cHicient.  algorithm  in  Section  4  is  derived  from  the  second 
of  these  algorithms. 

A  natmal  approach  to  solving  Problem  Ml  is  to  see  whether  the  Bellman-Ford  relaxation 
approach  win  be  made  to  work.  Since  we  have  both  integer  and  real  vertices  in  the  graph, 
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Figure  1.  An  inslanrc  of  Problem  Ml.  Integer  vertices  (Vi  =■  {1.4})  are 
shown  as  squares  and  real  vertices  ;ls  circles. 

however,  we  must  modify  I  he  relaxation  step  HIT)  in  the  Mellman-Ford  algorithm  lo  produce  an 
integer  value  whenever  j  is  an  integer  vertex  (line  lift).  This  approach  does  in  fact  work,  but 
it  requires  more  iterations  than  the  simple  Hell  man- Kurd  algorithm.  The  next  algorithm  solves 
Problem  MI.  The  number  of  iterations  n  in  line  R2  will  be  determined  in  I  he  analysis  following 
the  algorithm. 

Algorithm  R  (Relaxation). 

III.  foreach  i  €  V  do  xx  «—  0; 

i{2.  for  ind  «—  1  to  n  do 

ITT  foreach  (i,j)  6  E  do 

IN.  begin 

Ifa.  x j  ♦-  min (zj,  x,  +  a,;); 

Iff).  if  j  €  Vj  then  x:  <-  [z;J; 

R7.  end; 

If  8.  foreach  (t,  j)  £  E  do 

R9.  if  Zj  >  z,  +  a, j  then  Fail ; 

In  order  to  determine  a  value  of  n  such  that  Algorithm  If  works,  we  introduce  the  notion  of 
a  reducing  path.  Let  p  be  a  path  starting  at  some  vertex  k ,  and  suppose  that  xj,  is  initially  sot  to 
(I  and  that  all  the  remaining  x,  are  initialized  to  oo.  Suppose'  the  edges  in  path  ;>  are  traversed 
in  order  starting  from  k,  and  each  edge  (i.j)  along  the  path  is  relaxed  as  in  statements  If 5  R6. 
If'  each  relaxation  of  an  edge  (i,j)  reduces  the  value  x:,  the  path  p  is  called  a  reducing  path. 

Whenever  a  sequence  of  edges  contains  all  reducing  paths  as  subsequences,  the  relaxation  of 
each  eds'c  in  the  sequence  in  order  yields  a  solution.  (The  proof  is  analogous  to  Yen's  analysis 
'Li:  of  the  ii(  Ilman-Ford  algorithm.)  The  Heilman- Ford  algorithm  solves  Problem  I,  because  in  a 
sa! isiiable  graph  with  only  real  vertices,  each  vertex  occurs  at  most  once  on  any  single  reducing 
path.  (  And  in  fact,  every  shortest  path  is  a  reducing  path.) 

Win  n  some  unknowns  are  integer  and  some  are  real,  however,  it  is  possible  for  a  reducing 
path  to  visit  the  same  vertex  more  than  once,  even  if  the  graph  is  salisliable.  For  example,  in  the 
graph  shown  in  Figure  I,  the  reducing  path  p  =  3  — >2  — *  1  — ►  2  — <■  ,‘i  — *1  — >3  — *2  visits  vertices 
2  and  .i  three  times  each.  If  all  the  z,  are  initially  set  lo  0,  the  edges  of  p  must  be  relaxed  in 
l  lu  ir  order  along  the  path  to  achieve  convergence.  Moreover,  relaxing  the  entire  edge  set  in  some 
arbitrary  order  only  3  =  |K|  —  I  times  might  not  achieve  convergence.  Since  the  value  of  n  in 
line  R2  must  be  at  least  the  maximum  number  of  edges  in  any  reducing  path,  the  value  |V'|  —  1, 
which  was  used  in  Algorithm  I  IF,  will  not  sullice. 
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Fortunately,  reducing  paths  arc  never  very  long  in  satisfiable  graphs  because  of  the  following 
lemma. 

Lemma  1.  Suppose  C  (1,  V  / ,  E,n)  is  satisfiable.  If  p  is  a  reducing  path  in  C,  then 

1.  p  visits  no  integer  vertex  more  than  once,  and 

2.  p  never  visits  the  same  real  vertex  twice  without  visiting  some  integer  vertex  in 

between. 

Proof.  If  either  condition  is  violated,  then  the  reducing  path  p  can  be  extended  indefinitely  by 
repeating  the  cycle  that  causes  violation.  | 

Lemma  I  allows  us  to  determine  a  value  for  n  in  line  R2  of  Algorithm  U  such  that  the  x 
converges  to  a  solution  whenever  (',  is  satisliahle.  Any  reducing  path  contains  each  integer  vertex 
at  most  once  and  each  real  vertex  at  most  |F/|  +  1  times.  Since'  the  number  of  edges  in  a  path  is 

one  less  than  the  number  of  vertices,  any  reducing  path  for  a  satisliahle  graph  can  have  no  more 

than  \Vj\  -I-  (|V//|  +  I )| Kiel  —  I  —  |l'y[|L«[  +  |l'|  —  I  edges.  Thus  the  limit  n  of  the  outer  loop  in 
Algorithm  It  should  be  set  to  jF/||Fft|  T  jh  |  —  I.  The  overall  running  lime  of  Algorithm  It  is  thus 

(wmm.  _ 

This  analysis  suggest, s  the  following  algorithm  which  is  slightly  more  eflicient  than  Algorithm 
It,  and  which  forms  (lie  basis  of  the  asymptotically  efficient  algorithm  presented  in  the  next 
section. 

Algorithm  M  (Modified  relaxation). 

M 1 .  foreach  i  (E  V  do  x,  «—  0; 

M2.  for  ind  «—  1  to  |Fr|  do 

M3.  foreach  (i,j)  6  Er  do 

ML  x j  *-  min(iJ, x,  +  a,y); 

M5.  for  ind2  *—  1  to  |Ly|  do 
M6.  begin 

M7.  foreach  (i,  j)  6  Ej  do 

MS.  i}  <-  min(xy,[x,  + 

M9.  for  ind  *-  1  to  IFrI  do 

Mlt).  foreach  (i,  j)  6  Er  do 

Mil.  T}  *-  min(x;, x,-  +  a.y); 

Ml  2.  end; 

Ml 3.  foreach  (i,j)  £  E  do 

MM.  if  >  x,  +  n, j  then  Fail; 

The  only  difference  between  this  algorithm  and  Algorithm  It  is  that  it  treats  the  edges  in  Ei 
separately  from  the  edges  in  I'.r.  In  lines  M7  M8  of  Algorit  hm  M,  each  edge  in  /i;  is  relaxed  once. 
There  are  !V;|  such  passes  over  which  are  preceded,  followed,  and  separated  by  exhaustive 
relaxations  of  the  edges  in  Er  (lines  M2  Ml  and  Mtl  Ml  I).  In  each  exhaustive  relaxation  of  Er, 
edges  are  relaxed  until  no  further  changes  in  the  values  of  x:  are  possible  for  j  €  V r.  (Actually, 
the  relaxations  in  lines  M2  Ml  and  M!)  Ml  I  are  oidy  guaranteed  to  be  exhaustive  if  there  are 
no  negative-weigld  cycles  in  Er.  If  there  are  cycles  of  negative  weight,  however,  this  condition 
is  defected  at  the  end  by  the  convergence  lost  in  lines  MI3  MM.) 


4.  Dijkstra’s  algorithm  and  reweighting 

Section  5  gives  a  more  cllicicnl.  algorithm  to  solve1  Problem  Ml  Ilian  either  Algorithm  R  or 
Algorithm  M.  Three  important  techniques  are  used  in  the  algorithm.  The  lirsl  is  Dijkstra’s 
algorithm  which  finds  shortest  paths  in  a  graph  from  a  single1  source  in  the  case  when  all  the  edge1 
weights  are  nonnegative.  The  second  is  reweighting,  which  is  a  techniepie1  due  to  Fdmonds  and 
Karp  [3j  and  used  by  Johnson  [7)  in  his  ellicient  algorithm  for  solving  the  all-pairs  shortest-patks 
problem.  The  third  is  the  Fibonacci  heap  data  structure  due  to  Predman  and  Tarjan  [  1],  which 
is  an  improved  priority  queue  that  make's  Dijksl.ra’s  algorithm  run  in  time1  (){\l‘i\  +  |F|lg|F|). 

(liven  a  graph  (7  =  (V,lC,a)  such  that  all  e'elge1  weights  ax]  ari1  nonne-galive,  Dijkstra’s 
algorithm  computes  for  each  vortex  i,  the  weight  tlt  of  the  shortest  path  from  vertex  1.  Because 
each  edge  is  relaxeel  exactly  once,  this  algorithm  is  faster  than  the  Heilman- h'ord  algorit  hm  which 
solves  l  iie  same  problem  lor  arbitrary  edge  weights.  Dijkst  ra’s  algorithm  elerives  its  elliciency  from 
the  observation  that,  along  any  shortest  path  from  vertex  I,  the  shortest- pat h  weights  d,  form  a 
nondecreasing  sequence  if  all  the  edge  weights  are  nonnegative.  Thus,  a  sequence  consisting  of  all 
edges  (i,j)  £  E  in  nondecreasing  order  of  the  distances  <lx  contains  as  subsequences  shortest  paths 
from  vertex  I  to  all  vertices  in  V .  Furthermore,  such  a  sequence  of  edges  can  he  computed  on 
the  fly  using  a  priori ty  queue.  (The  textbook  [l]  gives  a  proof  of  correctness  for  this  algorithm.) 

Algorithm  D  (Dijkstra’s  algorithm). 

1)1.  x  |  4-  0; 

1)2.  for  i  4 —  2  to  |F|  do  xt  4—  00; 

D3.  Q*-V; 

1)1.  while  Q  ^  0  do 

l)b.  begin 

DO.  Choose  i  £  Q  such  that  x,  =  minj£Q 

i)7.  -{*}; 

1)8.  foreach  j  £  Fr  such  that  ( t,j )  £  Er  do 

D9.  Xj  4-  min(xj, x,  +  oty); 


If  the  set  Q  in  the  algorithm  is  implemented  as  a  standard  priority  queue,  each  extraction 
(lines  |)(i  1)7)  and  update  (line  1)9)  costs  f)(lg|(^|)  =  0(lgjF|)  time.  Thus  the  total  running 
time  of  Dijkst  ra's  algorithm  is  0(\E\ Ig  |V  |).  Fred  man  and  Tarjan  [  1 )  describe  a  data  structure 
•’ailed  Fibonacci  heaps  that  supports  arbitrary  deletion  in  f)(lg?i)  amortized  time  and  all  other 
standard  priority  cjiieuc  operations  (including  update)  in  constant  amortized  time.  By  using  a 
Fibonai  ri  heap  in  Dijkstra’s  algorithm,  they  show  that  the  performance  can  be  improved  to 
+  n'!igip|). 

.'since  Dijkstra’s  algorithm  is  equivalent  to  the  Bellman-Ford  algorithm  on  graphs  with  non¬ 
negative  edge  weights,  it  can  be  used  to  solve  Problem  I,  on  such  graphs.  This  is  not  very 
interesting  in  itself,  since  any  graph  C  ~  (V,E,a)  in  which  all  edge  weights  are  nonnegative 
can  be  trivially  satisfied  by  setting  x,  to  0  for  each  i  €  F.  Our  interest  in  Dijkst  ra’s  algorithm 
comes  from  a  stronger  property  of  the  solutions  it  finds.  Suppose  the  initialization  step  (lines 
1)1  1)2)  is  changed  so  that  each  variable  x,  is  initialized  to  a  (ini to  value  Then  the  relaxation 
procedure  in  lines  1)3  DIO  will  set  each  x,  to  its  largest  possible  value  consistent  with  the  con¬ 
straints  that  x;  -  /,  <  aXJ  for  each  edge  (i,j)  £  E  and  that  x,  <  u,  for  each  vertex  ?  £  F.  In 
other  words,  lines  1)3  DIO  of  Dijkstra’s  algorithm  are  functionally  equivalent  to  lines  BF3  HFT> 


<>l  Ui<‘  HcllmanT'ord  algor:!  Inn  provided  that  all  the  edge  weigh!, s  iitJ  are  noMncgalive.  Since  a 
graph  with  only  nonnegal.iee  edge  weights  can  never  contain  a  negative- weigh!  cycle,  no  lost  lor 
convergence  is  necessary  in  I  his  case. 

The  ellicient  algorithm  we  shall  present  to  solve  Problem  Ml  is  a  modification  of  Algorithm 
M.  Notice  that,  lines  Ml)  Mil  of  Algorithm  M  exhaustively  relax  the  edges  in  ICr  in  a  manner 
similar  to  lines  HK.’i  HI '5  of  the  Hellman-I'ord  algorithm.  In  Algorithm  M,  however,  this  code  is 
executed  many  times.  I'lic  ellicient  algorithm  to  solve  Problem  Ml  uses  a  trick  to  replace  this 
code  with  code  based  on  the  more  ellicient  relaxation  procedure  in  lines  1)3-1)10  of  DijksLra’s 
algorit  hm  This  t  rick  is  the  technique  of  rewt  ighting  due  to  Kdmonds  and  Karp  [,'ij . 

Lemma  2.  Let  (',  — -  It  ,  o  I  be  an  edge-weighted  graph,  for  each  i  £  V’  let  r,  be  a  real 
number,  and  let  II  —  .  I  ,  1C,  h)  where  bXJ  =  a +  r,  —  r3  for  each  edge  ( i,j )  £  1C.  For  each 
vertex  i  £  V'  let  x,  be  a  real  number  and  let  yx  —  j,  — r,.  Then  t2  —  x,  <  tiXj  for  all  ( i,j)  £  1C 
if  and  only  if  y2  —  yx  hlJ  for  all  ( i.j )  £  1C  (that  is,  x  is  a  solution  to  ('•  if  and  only  if  y  is 
a  solu  tion  to  II .) 

Proof.  Trivial.  | 

We  call  the  vector  r  =  (f|,  r2, . . . ,  i-jvq)  a  reweighting  of  the  graph  (7. 

5.  An  asymptotically  efficient  algorithm  for  solving  Problem  MI 

This  section  shows  how  Dijkstra’s  algorithm  and  reweigh  ling  can  he  incorporated  into  Algo¬ 
rithm  M  to  yield  a  faster  algorithm  for  solving  Problem  Ml.  (liven  a  graph  (7  =  (P,  P/,  1C,  a),  the 
idea  is  to  find  a  reweighting  r  such  that  the  reweighted  graph  II  =  (V',  P;,  1C,  b)  has  edge  weights 

=  «,j  -r  r,  -  r3  >  0  for  all  edges  (i.j)  £  lift.  Lemma  2  guarantees  that  C  is  salisfiahle  if  and 
only  if  //  is  salisfiahle  and  also  that  a  solution  y  to  II  can  be  converted  into  a  solution  x  to  C  by 
setting  x,  =  i/,  +  r,  for  each  i  £  V .  The  advantage  gained  by  transforming  the  problem  on  G  to 
a  problem  on  II  is  that  the  relaxation  portion  of  Dijkstra’s  algorithm  (lines  1)15  1)10)  can  replace 
the  Hcllrnan-Ford  relaxation  (lines  Mil  Ml  1),  which  is  the  most  expensive  part  of  Algorithm  M. 

The  first  stage  of  the  algorithm  is  to  determine  the  reweighting  values  rt  for  all  i  £  V  and 
the  new  edge  weights  6,y  =  a,  +  r,  —  r,  for  all  {i,j)  £  1C.  We  must,  choose  the  values  r,  such 
that  btJ  >  0  for  all  (i,j)  £  1C  a-  Since  this  is  equivalent  to  requiring  that  r;  —  r,  <  nl}  for  all 
(*,  j)  6  1C // ,  values  for  the  r,  can  he  found  by  applying  the  Hellman-Ford  algorithm  to  the  graph 
( V,ICji,a ).  The  first  few  lines  of  the  algorithm  arc: 


AJgorith 

m  T  (l CJJirient.  algo-ithm). 

Tl. 

for  i  £  V  do  r,  0; 

T2. 

for  ind  <—  1  to  |P/j|  do 

T3. 

for  (i.j)  £  IC,{  do 

T-t. 

r,  *-  min(ry, r,  +  atJ); 

T5. 

for  (i.j)  £  ICr  do 

TO. 

if  Tj  >  r,  +  then  Fail 

T7. 

for  (i.j)  £  1C  do 

T8. 

0,,  a,j  +  r,  —  fy; 

If  the  algorithm  fails  in  line  TO,  then  there  is  a  cycle  of  negative  weight  among  the  edges  in 
Fr.  and  li  nee  graph  (1  is  urisal isliable  even  in  the  absense  of  integer  constraints.  Othe  rwise,  the 
values  b,;  computed  in  line  TX  are  nonnegative  for  all  (i,j)  £  ICr. 
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The  next  stage  of  Algorithm  '1'  is  to  solve  llte  mixed-integer  problem  on  the  graph  II  — 
(T.  \'i,ll,h).  The  algorithm  alternately  performs  single  relaxation  passes  on  the  edges  in  Fj  and 
exhaustive  relaxations  of  the  edges  in  llR,  as  in  Algorithm  M.  We  begin  by  initializing  Lite  values 
t/,,  which  will  converge  to  a  solution  to  II  if  II  is  satisfiable. 

T9.  for  i  £  V7  do  yx  «—  0; 

'Phis  initialization  has  the  added  fortune  of  subsuming  the  first  exhaustive  relaxation  of  FR  (lines 
M2  Ml  in  Algorithm  M).  After  the  execution  of  line  T9  we  have  —  v,  =  0-0  <  bXJ  lor  all 
(?,/)  £  I'hf,  which  means  that  the  edges  in  i'.H  are  already  exhaustively  relaxed. 

The  nex t  portion  of  Algorithm  T  parallels  lines  Mb  MI2  of  Algorithm  M  and  is  where  most 
of  the  computing  gets  done. 

T10.  for  ind  <—  I  tc  ]l7/|  do 

Til.  begin 

TI2.  for  (i,j)  £  I'li  do 

T13.  *-  minfj/j,  [y,  +  6,,J); 

TM.  Q*-V; 

TI5.  wl,  i!e  Q  ^  0  do 

T16.  begin 

T17.  Choose  i  £  Q  such  that  yx  =  min jeQVv 

TI8.  Q*-Q-  {t}; 

T19.  for  j  £  VR  such  that  (i,j)  £  ER  do 

T20.  y,  *-  min(j/y,y,  +  btJ); 

T21.  end; 

T22.  end; 

This  cod<'  solve"  the  problem  ori  graph  II  in  almost  exactly  the  same  way  that  Algorithm  M 
would.  The  only  difference  is  the  method  by  which  the  edges  of  i',K  are  exhaustively  relaxed. 
Whereas  lines  M9  Mil  of  Algorithm  M  perform  the  exhaustive  relaxation  using  the  Bellman- 
Ford  algorithm,  lira's  TM  T2I  of  Algorithm  T  take  advantage  of  the  nonnegativity  of  the  bx}  for 
(i,j)  £  Hu  and  use  Dijkstra’s  algorithm. 

The  final  part,  of  Algorithm  T  is  to  check  the  convergence  of  the  y  and  to  apply  Lemma  2  to 
produce  a  satisfying  assignment  x  for  the  original  graph  C. 

T23.  for  (i,j)  £  Fj  do 

T21.  if  y3  >  yx  +  bX}  then  Fail; 

T2b.  for  (i,j)  £  K  do 
T2f>.  t.x  *-  yx  +  rx; 

Lines  T2.‘i  T21  check  the  convergence  of  y  by  testing  the  inequalities  associated  with  the  edges 
i’i  The  inequalities  resulting  from  edges  in  II R  need  not  be  checked  because  the  relaxation 
in  lines  TM  T22  is  guaranteed  to  be  exhaustive.  (If  there  were  negative- weight  cycles  in  FR,  we 
would  have  delected  this  in  lines  T5  T6.) 

Line-  T2b  T?(>  convert  the  solution  y  to  graph  II  into  a  solution  x  to  graph  (!.  Lemma  2 
ensure  -  that  the  inequalities  x}  —  x,  <  ax]  are  salislied.  but  we  must  also  show  that  the  xx  are 
integers  for  all  i  £  Vj.  For  each  i  £  l’/  the  value  y,  is  an  integer,  however,  and  furthermore,  the 
values  of  the  r,  produced  in  lines  T!  'IM  are  zero  for  all  ;  £  I  /.  Thus  for  all  the  integer  vertices, 

I  he  /,  are  integers. 

In  summary,  we  have  proved  the  following  theorem. 
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Thee  rem  3.  Algorithm  T  tulve*  Problem  MI. 

The  ri  lining  time  nl  Me.nrit  h  in  I  l|/-.'j  •  t  f|l'/[lg|l  ||.  if  (In  priority  (juftir  is  imple¬ 

mented  icing  a  I  ihonaeei  heap. 

6.  App  ieat  ions,  extensions,  and  conclusions 

The  so  nlion  In  I  *  r  o  l  >  I  *  * :  1 1  Ml  was  ilcinaiiileil  by  a  problem  i-omir  n  i  n  p,  optimization  of  sychronous 
eircuilry  iy  retiming  jllj.  Ibis  mHIhii  hrielly  describes  two  other  problems  eompaclion  of 
\  LSI  circiils  in  the  pi. si  nee  of  power  ami  urouiid  buses  ami  I’KIvT  scheduling  with  periodic 
const  rai  lit  c  which  ran  be  r<  dm  mt  to  L robiem  Ml.  We  also  eon-ale r  an  e\  t ension  of  I  ’ruhlem  Mi 
where  multiple  classes  ol  peri  >die  cons1  rai nt s  must  hi  >ai islied.  (for  example,  some  of  the  xt  are 
required  I  i  lie  integers,  ami  ol  her-  to  be  exael  multiples  of  an  integer  constant  r.) 

Circuit  compaction 

( )pl  i  m  il  (one- 1  li  iiieiisional)  com  pad  ion  ol  \  LSI  ci  reni  t  layout  -  L:»j  is  a  no!  in  r  app  lie, at  ion  of  l  lie 
Bellman-lord  algorithm.  Kaeh  layout  Lalure  is  given  a  variable  representing  an  ■/■-coordinate, 
and  the  design  rules  are  enforced  using  constraints  of  the  form  x  i ,  <  It  may  he  desirable, 
however,  to  allow  feature  i  to  be  to  the  left  of  feature  j  or  vice  versa,  but  not  to  allow  them 
to  occupy  the  same  posit, ion.  I  ninrt  innately.  if  one  wishe-  '<•  allow  this  kind  of  transposition  of 
layout  feamres,  cither  optimality  or  performance  must  b(' sacrificed  because  I  hr'  problem  becomes 
Nl  ‘-compl 't  ('  [  I  ()].  Hut  for  certain  compact  ion  problems  arid ng  in  practice,  t  ransposilioii  of  layout 
features  can  be  allowed. 

Some  (  ('sign  met  hodologies  enforce  the  placement  of  power,  ground,  and  clock  to  be  at  regular 
intervals.  For  example,  one  signal  processing  system  [||j  requires  that  these  wires  ho  repeated 
every  200,'.  and  that  the  width  of  all  cells  in  the  system  he  integer  multiples  of  ibis  distance. 
The  dcsigi  or  is  then  constrained  to  build  a  new  coll  so  that  tin  layout  features  are  tightly  packed 
among  tin  global  wires.  In  this  context,  where  some  layout  features  may  go  on  one  side  or  the 
other  of  some  giobni  wire  but  may  not  overlap,  the  compaction  problem  can  be  formulated  as 
Problem  MI. 

PERT  scaeduling 

Suppo.e  we  have  a  constraint  graph  with  vertices  representing  milestones  iri  a  project,  and 
edge- weigl  Is  indicating  ihe  liming  const  raints  between  milestones.  (Lnerally,  the  Bellman-Ford 
algorithm  "an  lx  used  to  provide  an  optimal  scheduling  of  the  milestones.  If  a  work  day  is  from 
!):()()  a. in.  to  TOO  p.m.,  however,  we  may  not  wish  to  schedule  a  one  hour  job  to  start  at  4:30 
p.m.  Adv:  neing  the  job  to  the  next,  day  may  cause  an  earlier  job  to  be  advanced  as  well  if  the 
two  jobs  a  •(■  eons' rained  to  fa.  1 1  near  each  other.  The  problem  of  I’KUT  scheduling  with  periodic 
constraint'  can  bo  cast  as  Problem  MI. 

Intiiith  ely,  the  niixed-mtc  ger  formulation  allows  one  to  include'  for  each  job  ( I)  a  real  variable 
representing  the  starting  lime  of  the  job,  and  (2)  an  integer  variable  representing,  say,  noon  on 
the  day  th  :  job  occurs.  Thus  one  can  inc  lude  constraints  which  say,  for  example.  “This  job  must 
start  befor"  '1:0(1  p.m.  on  the  day  it  occurs.” 

Multiple  periodic  constraints 

>.iippo;  1  that  in  the  PI’.UT  scheduling  application  mentioned  above,  we  also  wish  to  take  into 
consult  rat  on  <  oie raints  involving  weekends.  To  do  this,  we  would  associate  with  each  job  a 
third  vari:  hie  representing,  say,  Sunday  noon  of  Ihe  week  during  which  the'  job  occurs.  We 


arc  then  required  to  solve  a  variant  of  Problem  Ml  in  which  there  are  two  classes  of  periodic 
constraints  some  variables  are  required  to  be  exact  integers  and  others  to  be  exact  multiples  of 
7  while  the  remainder  may  have  arbitrary  real  values. 

The  solution  to  this  problem  is  based  on  the  following  algorithm  for  solving  Problem  Ml.  (We 
assume  without  loss  of  generality  that  (]  —  (V',  V/,  E,a)  is  strongly  connected). 

Algorithm  U 

III.  if  (V ,  F,a)  contains  a  negative- weight  cycle  then  Fail 
else  foreach  (i,  j)  £  Vj  X  Vj  do 

btJ  <—  [the  least  path  weight  from  i  to  j  in  (P,  F,a)\] 

U‘2.  if  (Vi,  V i  X  P/.h)  contains  a  negative-weight  cycle  then  Fail 

else  find  an  integer  assignment  x  on  P /  such  that  Xj  -  x,  <  for  all  i,  j  £  V /; 

U3.  A[>ply  the  Bellman-Ford  algorithm  to  ( P ,  F « , « )  using  the  x,  found  in  Step  U2  as 
initial  values  for  the  integer  vertices  and  infinite  initial  values  for  (he  real  vertices; 
Slop  |)|  produces  a  graph  II  =  (P/,P;  X  P i,b)  which  is  feasible  if  and  oidy  if  (!  is  feasible, 
Step  P‘2  solves  II  if  II  is  feasible,  and  Step  l 'll  extends  the  solution  from  the  set  V/  of  integer 
vertices  to  the  entire  vertex  set.  P.  Stef)  (JI  can  be  performed  in  0(\V\')  time  by  the  Floyd- 
Warshall  algorithm  [8]  or  in  0(|P||/'’|  +  |P/||P|  Ig  |P |)  time  by  Fredman  and  Tarjan’s  improved 
version  [1]  of  Johnson’s  algorithm  [7].  Step  1)2  can  be  performed  by  the  I  {oilman- Ford  algorithm 
and  takes  time  0(|P/|'*)  because  II  is  a  complete  graph.  The  cost  of  Step  III  dominates  the  cost 
of  Step  U3,  which  takes  only  0(|P||/i/i|)  time. 

Algorithm  U  extends  naturally  to  the  case  in  which  there  arc  multiple  classes  of  periodic 
constraints,  provided  that  each  period  ( e.g .,  1  week)  is  an  exact  multiple  of  the  next  smaller 
period  (e.g.,  I  day).  First,  Step  U 1  is  applied  (with  an  appropriate  scaling  of  the  edge  weights) 
to  produce  an  equivalent  problem  in  which  the  most  loosely  constrained  class  of  vertices  in  the 
original  problem  is  eliminated  from  consideration.  This  new  problem  is  then  solved  recursively 
(or  by  direct  application  of  Algorithm  T  if  only  two  classes  of  vertices  remain).  Finally,  the 
solution  is  extended  to  the  entire  set  of  vertices,  as  in  Step  U3. 
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